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Introduction 


It  has  been  proposed  that  procedures  for  routine  determination  of  the 
position  of  an  aid  to  navigation  should  be  revised  so  that  the  position 
is  "over-determined"  by  observations.  Redundant  data  are  to  be  obtained 
so  that  the  precision  and  accuracy  of  the  position  location  may  be 
assessed.  Redundant  observations  can  also  provide  on-site  checks  against 
gross  errors,  and  can  be  used  in  evaluation  of  systematic  errors,  but 
only  the  imprecision  due  to  random  errors  is  considered  here. 

The  purpose  of  this  report  is  to  provide,  for  the  U.S.  Coast  Guard’s 
Aids  to  Navigation  Positioning  Project,  a statistical  model  and  procedure 
that  provides  (a)  an  estimate  of  the  position  location  and  (b)  a confi- 
dence region  for  the  position  location.  Using  the  model,  it  is  shown 
how  the  analysis  should  be  modified  for  the  following  special  circumstances 

(i)  replications  of  some  or  all  observations, 

(ii)  estimates  of  individual-observer  standard  deviations, 

(iii)  systematic-error  checks  obtainable  from  "closing  the  circle" 
or  from  other  known  relationships  among  observed  angles. 
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Various  positioning  methods  are  used  (radar,  sextant  angles,  etc.),  but 
all  can  be  described  in  general  terms  as  follows.  With  respect  to  a 
known  "assumed  position"  (in  practice  very  close  to  the  unknown  position), 
each  observation  determines  a "line  of  position  (LOP)."  If  there  were 
no  measurement  errors,  and  if  the  assumed  position  were  correct,  each 
LOP  would  pass  through  the  assumed  position  with  a known  direction 
(calculated  from  the'  assumed  position  and  the  known  locations  of  fixed 
objects  on  which  observations  are  made).  In  practice,  an  observed  LOP 
is  taken  to  be  parallel  to  the  calculated  LOP,  and  the  distance  from  the 
observed  LOP  to  the  assumed  position  is  calculated  from  the  measurements. 

Remark  on  geometry:  The  calculated  lines  of  position  are  often  derived 

as  lines  tangent  to  small  circles,  or  sometimes  to  hyperbolas  or  great 
circles.  Errors  of  the  assumed  position  and  of  measurement  would  in 
general  imply  that  the  observed  LOP's  should  be  associated  with  slightly 
different  circles.  Since  the  errors  are  in  practice  relatively  small, 
it  is  customary  to  ignore  the  latter  complication,  which  is  negligible 
when  the  assumed  position  is  sufficiently  close. 


Coordinate  System  and  Notation 


Let  the  origin  be  at  the  known  assumed  position  and  let  the  positive  x- 
axis  lie  in  a fixed  direction  (North)  from  the  origin.  In  this  coordinate 
system,  each  calculated  LOP  is  determined  by  its  angle  with  the  x-axis, 
taken  to  be  positive  when  measured  in  the  clockwise  direction.  Since 
the  problem  is  invariant  when  the  direction  of  an  LOP  is  reversed  ( l80° 
change),  the  convention  is  adopted  that  the  angle  between  each  LOP  and 
the  x-axis  is  between  0°  and  180°.  The  framework,  then,  is  the  given 

coordinate  system  and  the  angles  0.,  0_,  ...,  0 of  n calculated  LOPs. 

12  n 


• * 5 
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An  observed  LOP  differs  from  the  corresponding  calculated  LOP  by  being 
translated  parallel  to  the  calculated  LOP  by  a distance  d.  The  algebraic 
sign  (positive  or  negative)  of  the  distance  d is  taken  to  be  positive  if 
the  observed  LOP  intersects  the  positive  x-axis.  Thus  the  observed  LOP 
corresponding  to  the  angle  0 is  specified  by  a distance  di(i=l,  2, 
n).  The  equation  of  the  ith  observed  LOP  may  be  written 

y=d.  sec  0.-x  tan  0. 

l l l 

or 

x sin  0.  + y cos  0.  = d.  . 
l ii 

Let  (y  , y ) denote  the  coordinates  of  the  unknown  actual  position  P at 
x.  y 

which  observations  were  made.  A line  through  P parallel  to  the  ith  LOP 
has  the  equation 

xsin0.+ycos0.=y  sin0.+y  cos0.=E.  , 
l ix  iy  ii 

is  seen  to  be  the  unknown  error  of  the  assumed  position 
the  direction  perpendicular  to  0^.  Finally,  the  unknown 
from  P to  the  observed  LOP  is  d.-E., 

l l 

D.=d.-y  sinO.-y  cos0.. 
l l x l y l 

Statistical  Model 


where  (-E^) 
(origin)  in 
distance  D. 

l 


The  basis  for  the  statistical  model  is  the  set  of  observation  equations 


d.=y  sin0.+y  cos0.+D.,  i=l,  n. 

ix  l y l l ’ ’ 


The  angles  0^  are  known  and  the  coordinates  of  P are  to  be  estimated. 
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The  errors  D , D^,  . ..,  are  assumed  to  be  statistically  independent 
and  normally  distributed  with  zero  means.  The  variances  of  the  are 
unknown,  but  their  ratios  are  known;  that  is,  constants  are  given 
such  that  the  variance  of  is 

a . 2=W. 2a2 . 

1 1 

The  constants  W_^  are  defined  and  interpreted  as  follows.  There  is  given 
a "gradient"  depending  on  the  geometry  of  the  measurement  situation 
for  the  line  of  position,  which  relates  measurement-reading  errors  (such 
as  angle  readings  in  minutes)  to  distance  errors.  If  the  observers  are 
all  equally  precise,  then  W.=G. , a2  is  the  observer  variance  for  angle 

'Xf  r\ 

determinations,  and  o * is  the  variance  of  corresponding  distance  errors. 

If  the  measurement  errors  for  different  observers  are  different,  then 
there  is  an  additional  constant  IL  such  that  the  variance  for  the  partic- 
ular observer  who  measured  the  ith  line  is  H.2o2,  and 

— 1 

W.=G.H. . 

l li 

If  observer  variances  are  taken  to  be  known  in  advance,  then  the  constants 
can  be  defined  so  that  c2=l.  The  constant  EL  may  also  depend  on  the 
instrument  used. 

Estimation  of  Position  and  Variance 


Under  the  above  assumptions,  the  weighted  least  squares  estimates  of 

M and  y are  unbiased  minimum  variance  and  maximum  likelihood  estimates, 
x y 

These  estimates  are  calculated  by  minimizing 

E.(d.-y  sin0.-y  cos0.)2/W.2, 
l i x l y li* 


which  means  solving  the  equations 
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Iy  +Ky  =Z . d. sin0. /W. 2 , 
x y i i i i 


Ky  +Jy  =Z . d. cos0. /W. 2 , 
x y ii  ii 

where 

I=Z . sin20 . /W. 2 , 

l ii 


J=Z . cos20 . /W. 2 , 

l ii 


K=Z . sin0 . cos0. /W. 2 . 

l l ii 

The  underlying  variance  a2  is  estimated  by 


s2=Z.(d.-0  sin0.-fi  cos0.  )2/W.  2(n-2) , 
i l x i y i i 


where  y , y are  the  estimated  values.  The  divisor  is  n-2  because  two 
x*  y 

quantities  have  been  estimated,  leaving  n-2  degrees  of  freedom  for 
evaluation  of  measurement  errors. 


Even  if  a2  is  taken  to  be  equal  to  one  (observer  variances  known),  it  is 
advisable  to  calculate  s2.  A control  chart  plotting  the  value  of  s for 
successive  position  determinations  would  provide  a check  on  the  assumed 
known  values.  The  procedure  for  establishing  control  limits  on  the 
control  chart  is  given,  for  example,  in  the  ASTM  manual  on  control  chart 
analysis.  Part  3,  Section  9 and  Table  27,  where  "three-sigma"  limits  are 
suggested.  (The  control  limits  for  an  ordinary  standard  deviation  are 
equally  applicable  to  the  square  root  of  the  residual  variance. ) Also 
useful  are  "warning  limits"  at  plus/minus  "two-sigma."  When  a point 
falls  outside  the  warning  limits,  this  is  a signal  to  investigate.  For 
instance,  if  it  appears  that  the  points  have  been  falling  above  the 
center  line  too  often,  it  may  be  necessary  to  reinvestigate  the  estimation 
of  the  H-factors,  i.e.,  the  individual  observers'  variances  and  instrument 
variances . 


' 
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Confidence  Region 

There  are  two  cases,  according  as  o2  is  known  or  unknown. 

The  confidence  ellipse  for  the  point  (y  , y ) at  the  0.95  probability 

x y 

level  is  given  by  setting  the  quadratic  form  below  equal  to  a constant: 

1 ( yx"Px)2+J  ( VMy ) 2+2K(  Vyx)(  yy"yy )=C ' 

When  o2  is  known,  the  constant  is 


C=a2X2(2,  .95), 

and  when  o2  is  unknown,  the  constant  is 

C=2s2F(2,  n-2,  .95), 

where  x2(2,  -95)  denotes  the  0.95  point  (upper  5%  point)  of  the  chi- 
square  distribution  with  2 degrees  of  freedom  and  F(2,  n-2,  .95)  denotes 
the  0.95  point  (upper  5%  point)  of  the  F-distribution  with  2 and  n-2 
degrees  of  freedom. 

When  the  number  of  lines  is  small,  the  number  (n-2)  of  degrees  of  freedom 
for  estimating  a2  is  small  and  the  estimate  is  highly  variable.  The 
effect  of  this  on  the  size  of  the  uncertainty  ellipse  is  seen  in  the 
following  values  of  the  probability  distribution  constants. 


X2 ( 2 , .90)  = U.6l  x2 ( 2,  .95)  = 5-99 


F(2,  1, 

.90)  = 1+9.0 

F(2,  1, 

• 95 )=199- 5 

(n=3) 

F(2,  2, 

.90)  = 9-00 

F( 2,  2, 

. 95 )=19- 00 

(n=4) 

■ ' 


. 
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The  elliptical  locus  of  points  (y  , y ) bounding  the  confidence  region 

x y 

has  one  of  its  axes  at  an  angle  0 with  the  x-axis  (measured  counter 
clockwise)  defined  by 


tan  20=2K/(I-J),  |0|<U5°. 

For  K#0,  I^J,  the  half-length  of  the  axis  in  the  direction  0 is 

a=C1^2[J+K  cot  0]"1/2  . 

The  half-length  of  the  axis  in  the  perpendicular  direction  is 

b=C1//2[l-K  cot  0 ]~1//2  . 

If  I<J,  the  first  of  these  is  the  major  axis;  if  I>J,  the  second  is  the 
major  axis. 


If  K^O  and  I=J,  then  0=1+5°  and 

a=Cl/2(l+K)"l/2  , b=C1/2(l-K)~1/2  ; 

the  first  of  these  belongs  to  the  major  axis  if  K is  negative. 

If  K=0,  then  0=0  and 

a=(C/l)l/2  , b=(C/j)l/2  . 

Dependent  Lines  of  Position 

Suppose  three  LOPs  L^,  L^,  are  related  in  the  following  way:  is 

based  on  the  bearing  difference  taken  to  two  fixed  points  A and  B. 

Next,  the  bearing  difference  between  B and  C determines  and  finally, 
the  difference  between  A and  C determines  L^.  The  three  measurements 
are  statistically  independent;  the  mathematical  relationship  among  the 
three  angles  has  no  effect  on  independence.  If  the  observed  bearing 


■ 
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differences  are  changed  in  some  way  to  force  the  observed  angles  to  add 
correctly,  the  resulting  altered  values  of  d^,  d^,  d^  would  indeed  he 
correlated;  but  such  an  adjustment  is  not  recommended  since  it  is  equiva- 
lent to  changing  the  estimation  procedure. 


In  general,  there  seems  to  be  no  special  advantage  to  be  gained  from 

using  the  information  about  relations  among  the  angles.  Whenever  there 

are  three  or  more  lines,  n >_  3,  then  y and  y can  be  estimated  from  any 

x y 

subset  of  two  or  more.  The  data  contain  n-2  degrees  of  freedom  for 
estimating  s2  and  ordinarily  it  would  be  preferable  to  use  all  lines 
symmetrically  rather  than  to  look  at  the  distance  from  one  line  to  the 
point  determined  by  other  lines. 


If  there  are  four  or  more  lines,  however,  the  sum  of  squares  of  residuals 

having  n-2  degrees  of  freedom  (d.f.)  can  be  written  as  the  sum  of  two 

terms,  one  with  n-3  d.f.  associated  with  the  residual  variance  for  a 

position  P*  located  by  n-1  lines,  and  a second  term  with  one  d.f.  for 

the  distance  from  P*  to  the  nth  line.  This  comparison  might  be  utilized 

in  an  attempt  to  isolate  an  "outlier"  measurement  if  the  s2  calculated 

from  all  n lines  appears  to  be  too  large.  Specifically,  let  r^  denote 

the  distance  from  the  nth  line  to  the  position  calculated  from  the  other 

n-1  lines  and  let  s 2 denote  the  estimate  of  c2  calculated  with  the  nth 

n — 

line  omitted.  Then  compute  the  ratio  of  r 2/W  2 to  s 2.  Repeat  the 

n n n 

calculation  for  each  subset  of  n-1  lines.  If  one  of  the  ratios  is  much 
larger  than  all  the  others,  suspicion  points  to  the  corresponding  omitted 
line . 


Closing  the  Circle 

As  in  the  case  of  the  sum  of  two  adjacent  angles,  just  considered,  it  is 
not  recommended  that  the  observed  lines  of  position  be  adjusted  by 
forcing  the  angles  between  bearings  to  add  up  to  360°.  The  check  on  the 
sum  of  angles  is,  of  course,  useful  as  a check  for  gross  errors.  But  an 
adjustment  would  induce  correlations  among  the  observations. 


- 
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Selection  of  lines  to  provide  for  checks  on  the  angle  measurements  is 
desirable  for  investigation  of  systematic  errors,  even  though  it  does 
not  lead  to  any  improvement  of  estimates  of  random  error. 

Replications  of  some  or  all  of  the  LOP's 

Suppose  the  data  for  each  LOP  are 

d^  , , J — 1» 2, . • • , n^ , i — 1,  . . . , n, 

where  nl>l.  The  maximum  likelihood  estimates  may  be  obtained  from 

N=En^  lines  in  exactly  the  same  way  as  before,  but  it  is  known  from 

least  squares  theory  that  mathematically  identical  results  (estimated 

values  of  p and  p ) will  be  obtained  using  the  n equations 
x y 

d.  = p sin  0.  + p cos  0. , 
ix  i y i 


with  appropriate  weights.  If  the  n^  measurements  on  the  ith  line  are 
all  made  with  equal  variances  (e.g.,  by  the  same  observer),  then 


d. 

l 


+ d. 
in . 
l 
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and  the  solution  is  obtained  by  least  squares  with  weights  n^/VT2. 

That  is,  one  uses  the  n lines  specified  by  d^  and  0^,  taking  the  number 
of  replications  into  account  in  the  variances. 


If  the  variances  of  the  replicated  d_  are  different,  then  the  weights 
for  the  individual  observations  are  the  squared  reciprocals  of 


W.  .=G.H.  . 
ij  1 iJ 


and  d^  is  the  weighted  mean 


d.=(d.  H.  2+...+d.  H.  2 )/(H.  2+...+H,  2 

i il  il  in.  m.  il  in. 

ii  l 
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The  weight  for  the  ith  equation  in  the  least  squares  calculation  is 

G.2/E.H. .~2  . 
i J ij 

If  the  W.  are  very  different,  replications  can  be  used  to  equalize  the 
weights . 

Also,  additional  information  about  a2  can  be  obtained.  In  addition  to 
the  estimate  of  o2  obtained  from  the  analysis  using  the  "average"  lines, 
there  is  an  approximate  estimate  of  o2  calculated  from  the  sum  of  squares 
of  deviations  within  groups  of  replications, 


E . E . (d. .-d. )2/ (N-n)G. 2H. .2, 
i J ij  i i ij 


Large  differences  between  these  two  estimates  of  o2  would  indicate 
either  systematic  errors  of  measurement  or  flaws  in  the  statistical 
model. 


Standard  deviations  of  individual  observers 


An  estimate  based  on  exactly  3 LOP's  provides  only  one  degree  of  freedom 
for  estimating  error,  so  that  the  effects  of  individual  observers  are 
confounded.  The  estimates  of  o2  obtained  from  a series  of  different 
position  location  operations  performed  by  the  same  team  of  observers 
could  be  plotted  on  a control  chart  and  a long-run  estimate  could  be 
obtained.  It  would  also  be  useful  to  plot  such  series  of  estimates  of 
o2  against  other  variables  that  might  be  suspected  to  be  associated  with 
systematic  errors  (one  might  be  visibility;  there  are  surely  many  others). 

The  design  of  an  experiment  including  replications,  to  isolate  individual 
observer  variabilities,  depends  on  the  details  of  field  operations.  For 
example,  suppose  each  line  of  position  is  calculated  from  observations 
by  one  observer.  Two  designs  could  be  considered: 
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(1)  Three  different  LOP's,  one  by  Observer  1,  one  by  Observer  2, 
and  one  by  both  observers. 

(2)  Three  different  LOP's,  two  by  Observer  1 and  the  third  determined 
twice  by  Observer  2. 

The  first  type  of  experiment  provides  information  about  the  difference 
between  observers.  The  second  type  provides  information  about  an  individ- 
ual observer's  variability.  There  would  be  many  other  possibilities. 

Each  such  experiment  provides  one  difference  measurement;  a sequence  of 
such  experiments  would  yield  estimates  based  on  any  required  sample 
size. 
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